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abstract 

In this paper we consider the problem of modeling and 
equalization of a nonlinear satellite channel. The channel is 
assumed to be bandlimited and exhibits both amplitude and 
phase nonlinearities A discrete time satellite link is modeled 
under both uplink and downlink white Gaussian noise. Under 
conditions of practical interest, a simple and computationally 
efficient design technique for the minimum mean square error 
linear equalizer is presented. The bit error probability and some 
numerical results for a BPSK system demonstrate that the 
proposed equalization technique outperforms standard linear 
receiver structures. 


I INTRODUCTION 

The problem of nonlinear channel modeling and equalization 
is of analytical and practical interest. An important example of a 
nonlinear channel is a digital satellite communication link, which 
uses a Traveling Wave Tube (TWT) amplifier operating in a 
near saturation region The TWT exhibits nonlinear distortion 
in both amplitude (AMAM conversion) and phase (AM/PM 
conversion). In addition, at high transmission rates the channel's 
finite bandwidth causes a form of distortion known as 
Intersymbol Interference (ISI). 

In this paper, we will examine the problem of modeling and 
equalizing this type of nonlinear satellite communication link. 
The observed data are corrupted by additive white noise, 
uncorrelated with the input data 

A number of other researchers have studied this problem. 
Fredncsson [lj. considered a QPSK system and specified an 
optimum linear receiver filter using a Mean Square Error (MSE) 
criterion. The channel nonlinearity in [1] was handled via 
successive number of linearizations Mesiya et al. [2-3] analyzed 
the BPSK system. In [2] a maximum likelihood receiver was 
considered, while in |3] a simpler linear receiver, based on the 
MSE criterion, was presented In both [2] and (3). the 
nonlinearity of the TWT is expressed in terms of Bessel function 
integrals. The MSE criterion was also applied by Bigiieri et al. 
[4] in their derivation of an optimum linear receiver. In [1], [3], 
and 1 4). the authors work in the frequency domain, and the 
solution is given in terms of integral equations that usually have 
to be solved using numerical techniques 

In [5], Ekanayake and Taylor presented a suboptimum 
maximum-likelihood type decision feedback receiver. However, 
because of the analytical complexity of their solution, they 
approximate the TWT with a hard limiter A different modeling 
approach was taken by Benedetto et al [6], First, they identify 
the whole channel using a Volte mi Series expansion [7], Then 
they suggest a nonlinear equalizer, based again on the MSE 


criterion. Although at the output of a nonlinear equalizer the 
MSE is smaller than the MSE at the output of a linear equalizer, 
it is not completely dear if there is a significant improvement in 
the probability of error performance of the system to justify the 
complexity of die nonlinear receiver. 

In this paper, we present the design and pe rf ormance analysis 
of the optimum linear MSE receiver for a nonlinear satellite 
channel. While the methods considered here are applicable to 
various in-phase and quadri-phase modulation systems, for 
simplicity and Lack of space we will illustrate this approach by 
using only BPSK examples. More generalized results will be 
presented elsewhere. There are two major differences between 
our design as compared to the above reviewed approaches. 
First, we use a very ample model for the input-output 
relationship of the TWT amplifier, proposed first by Saleh [8]. 
Second, by working in the discrete time domain we avoid the 
complex integral equations of the other approaches. In addition, 
a fast and simple iterative algorithm [9] permits the easy 
computation of the autocorrelation coefficients of the output of 
the nonlinear system. Thus, we are able to obtain a new simple 
and computationally efficient linear equalization technique under 
the MSE criterion. Based on the same modeling approach, a 
zero forcing type of linear equalizer was also presented in [10]. 

In Section 2, a simplified model for a typical satellite link is 
presented and the corresponding BPSK discrete model is 
derived The optimum MSE equalizer is presented in Section 3. 
In Section 4, the probability of error performance of the receiver 
is derived Finally in Section 5 some numerical examples, and 
comparisons with standard linear receivers are presented. 

n. CHANNEL MODELING 

Consider the simplified model of a digital satellite 
communication channel as shown in Figure 1. We will e x ami ne 
each one of the different subsystems composing this model. This 
study will enable us to derive an equivalent discrete model. By 
working in discrete time we will avoid the analytical problems 
arising with continuous signals. Our analysis is similar to that of 

Ekanayake and Tayloj [5]. 

The source output is a random sequence (U(d)} of equally 
probable uncorrelated symbols. Thus, in a BPSK system. 

U(n)=0-1) at n=0. T. 2T where P[U(n) == 1] = P[U(n) = 

-1] = 0.5, E[U(n)U(n-k)] = 0 for k » 0, and T ■' is the signaling 
rate. 

Let p(t) denote a pulse shaping function. Often it can be a 
rectangular function of unit amplitude over a time period of 
length T. In any case, the output of the modulator can be 
expressed in the form 
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*(»)■ £U(")pO-iiryuKu) C t, (i) 

where u, it the earner frequency. 

We (hell assume that the transmission filter is the one which 
determines the channel bandwidth. This filter is also responsible 
far the creation of IS. Let G(t) - 2g(t)cosu r r be the impulse 
response at this filter, where g(t) is the impulse response at a 
corresponding low pass filter. Then the output of this filter can 
be expressed as 

jjUin'M.-nT)^',. (2) 

where h(t)-g(t)*p(t). The purpose of our analysis is the design 
at a receiver structure for the estimation of the transmitted 
source symbol during the o tb signaling interval nT Sr s (n +1)7 . 
Thus during the n th signaling interval (2) can be rewritten as 

U(n)h(t-nT)cc6U't + £ U(i )h (t-iT)cosu> r / , (3) 

»iTst£(»i + l)T. 

The first term in (3) represents the transmitted symbol we want 
to estimate, and the second term represents the IS] due to the 
filter. 

On the uplink channel. r.(t) is corrupt ed by additive white 
Gaussian noise Thus, using the narrow band model for the 
noise, the input to the TWT can be expressed as 

0 ) * s. (r )+ n« (t )cosu> c r -n«, (r )sinu> r r. (4) 

iw(') and n„(i) represent the in-phase and quadrature 
components of the uplink noise, each with zero mean and 
variance a, 5 . From (3) and (4) 

*',(<)“ r.(i)cos(uj r f + X(r)). (5) 

where 



» 4 (t) 


rigor* 1: attaint* Ca— Scats— Hlta Hndal 

which are originally specified by the manufacturer. In Figure 2 
the P(r) and Q (r) functions of (10) are plotted for 
a, -2.0922,&, -1.2466, a, -5.529 and fi,«2.7088[8]. All 

input and output voltages were normalized. 

Because of the downlink additive white noise m(i), the 
received waveform r'a(») can be expressed as 

x'*(f)- sr(t)+/iar(')cos»u c r-n A (j)Hno> r r, (11) 

nT £ r £ (n + 1 )7. 

The signal j'*(/) of (11) is now coherently demodulated by a 
carrier 2cosu> c r . We assume that the bandwidth of the receiving 
filters is wide enough so that no additional ISI distorts the signal 
The output y(t) of the demodulator is sampled every T seconds 
to produce at the n th signaling interval the in- phase sample 


r.(t) - ((e (/ )*rw (i )) 2 +- n^(r )} H . 


( 6 ) y<")“y('o)=FM»o)]cosX(io)+ (12) 

♦ Q K ('o)jsinX(ro)- 1 n* («o). 


r(0» V(n)h(tnT)-<- £ U(i)li(i-,T). (7) 

I if • 

and 


k(r ) - tan 


i ”«.(') 

' 0 ) t «,(')' 


( 8 ) 


The TWT is a nonlinear memoryless amplifier. It exhibits 
nonlinear distortion in both the amplitude and the phase. Using 
a quadrature model, the outpui j,(r) of the TWT can be 
expressed in the form 


) - f [r. (/ )]cos(o) t i + k(t ))-£?[ r. (r )]sin(«u c r + k(r )). (9) 


(o is an appropriately chosen sampling instant within the interval . 
nT £r £ (n + 1)7. 

Under the assumption of high available power at the earth 
stations, the effects of the uplink noise can be considered 
negligible. Thus we can assume that X(r)=0. Then y(n) of (12 » 
becomes 

y(n)= P[r(r 0 )) + n^(ro) O') 

From (7) and (13) an equivalent discrete-rime model for the 
communication channel of Figure 1 can be represented as in 
Figure 3. Now. with U(n) = {!.-]}, the basic relationships are 


From Saleh [8] an expression of P(r) and Q(r) is given by 


F(r)-o, 

and 


T +JP 7 


(10a) 


r(n) = A^*f^hiU(n-k) , 

P(")=F[r(„)]- T f^ T . 


(14) 

0-M 


g(r) " a * d+C t y (10b) 

The coefficients of (10) are obtained by b least-square error 
curve fining procedure of the specific TV<T characteristics. 


y(n) = P(n)+w(n) , (16) 

where o and (5 are specified constants that depend on the 
qsdfic type of the TWT. w(n) is white Gaussian noise of zero 
mfin and variance ai, and uncorrelated with the input data. 
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The values of N1 mod N2 represent the memory of the 
transmitting filter. The gain A depends on the specific operating 
paint of the TWT. 

m. THE MEAN-SQUARE ERROR EQUALIZER 

Let the receiver output z(n) be expressed as the output of a 
Tapped- Delay Line (TDL) filter in the form of 

,(n) ’,S. c ' > ' ( "'* ) ' (17) 


Computation ef the Autocorrelation coefficient 

The sequence {P(n)} at the output of the nonlinearity can be 
considered at the output of a finite Sate sequential machine. 
Since the nonlinearity hat no memory, from (14) the state 
sequence can be given by 

#(«)- (t/(a+ATl) U(n),U(n-\) f/(aWV2)] . (21) 

{U(d)) is an i.i.d sequence, thus (s(n)) is taelf a stationary 
Markov chain [9], 

Let ut denote by II the transition probability matrix of the 
Markov chain (s(n)). A brute force evaluation of R p {) involves 
multi plication of square matrices of dimension [9-10], 

which would be computational unpractical unless special 
consideration is given to the special properties of H. In [9] a 
particularly effective and simple algorithm for the evaluation of 
autocorrelation coefficients of a nonlinear system was presented. 
The algorithm, as applied to our specific problem is given below. 

Algorithm for the computation of R p (k ) 

1. Let N-N1+N2+1, and store in vector f)o (of dimension 
V ) the values at the output of the nonlinearity for each state s(j) 
cf(21),forj-U,...^'. 

2. Compute the vector o« ( of dimension V ), where the j tb 
component is given by 

«o(/)-e.0)/2*.>«l,2 V . 

3. For k-0,l,...,N-l, do the- following computations 

•>) 

b) Store in the first 2* - *' 1 positions of a*, the vector a 4 *i, 
computed by 


where from (16), y(n)=P(n)+w(n). 


o»*t0') = “tO ) + “tG +2*’-*- 1 ) , y — l,2,...,2 A,-< ' 1 . 


In the theory of the Mean-Squares criterion, the tap weight 
coefficients {r,} of the equalizer are adjusted to minimize the 
mean square error 

€»«E[y(«)-Jj? *>>-*)]». (18) 

Minimization of (16) with respect to the {c ; l coefficients, yields 
the linear system of M= Ml + M2-t 1 equations 

V c i R,(J k)'‘R*,U)- M2. (19) 

*•*1 


c) Store in the first 2" 40 positions of of the vector, the 
vector P* _ i . where 


P»*t0) = 


fi*(2y-i)+3*(2y) 

, y-l,z, 


2/v-ti 


4. *,(*) = 0, forla/V. 

The above algorithm is easy to implement and requires only two 
vectors of size 2 s as basic computation storage. 

Computation of Cross-correlations 


where R,(k)~ R,(-k ) = E[y(n)y(n-k)) and *„(*) - 

E(U(n)y(n-k)] for all values of k. 

From the uncorrelatedness of the input data and the noise. 
R^(k)-= R m (k ). lot all values of k Also, since the output P(n) 
of the nonlinearity, and the noise w(n) are independent 

R,(k)= R,(k)+alh «. (20) 


Since for each state s(j) of (21) the value of P(s(j)]= 3oO ) 
has already been computed for the evaluation of the R p {) 
coefficients, a brute force technique can be easily applied for 
the evaluation of the cross-correlation terms. Thus from [10], 

*_(-*) = (l/2*->) y /•[*(/)]. -NlsksN2, (22) 


where o; is the variance of the noise. Thus in order to solve 
(19) it is necessary to evaluate first the necessary R p () and 
Rqjf) coefficients. While in the case of a linear channel the 
calculation for the R p {) coefficients is straightforward, in the 
nonlinear rase the evaluation may present some numerical 
difficulties. 


where the summation in (22) is done over all those states where 
U(n-k) = 1. 

Id summary, the design procedure for the optimum linear 
MSE equalizer is given as follows. First, compute the 2 s 
possible values of P(n) at the output of the nonlinearity. Then 
use the algorithm to compute the R p {) coefficients and (22) to 
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compute the R^A) coefficients. Finally, «olve the linear lynem 
in (19). The solution at (19) yields the tap-weight coeffideott of 
the MSE receiver. 

IV. EVALUATION OF BIT-PROBABILITY OF ERROR 

Unfortunately, there is no ample relationship between the 
residual mean square error of the MSE receiver and the bit error 
probability (11]. Fes' moderate channel and equalizer memories, 
a brute force method that yields an exact result could be applied. 
Denote by D, one of the 2***' 1 possible realizations at the input 
erf the receiver, with U(n)- 1, and by c the M x 1 vector at the 
filter coefficients Then from (16) and (17), the receiver output 
due to a specific input (U(n)) sequence is given by 

xj -D/c + Wc , (23) 

where Wu«M*Ml+M2-fl row vector erf noise samples. 

Let (w(n)) be a white noise sequence erf zero mean and 
variance oi. Let n-Wc. Then £[n]«0 and (t$- o2 y e 
Then with U(n)- 1 and for a threshold of zero, the conditional 


arm probability 

P.(i ) « Pr\D,c +n«V{l/fO}] , (24) 

is fixed, and 

MO-CP/f/o,). (25) 

where 

£?(*)- (26) 
Then the average error probability P, is given by 

P, - (1/I)£ MO- . (27) 

l ■ 1 

In our numerical example the SNR is defined as 

SSR = 10 log 10 (P^/2o 2) , (28) 

where £«, = (1/i )^ / , [r«' )(0)) 


If the exaci error probability of (27) proves loo cumbersome 
and too time consuming to evaluate because of the large number 
of terms, one can resort to a number of different approximate 
methods that yield tight upper and lower bounds of P r [11]. 

V. NUMERICAL EXAMPLE 

The purpose of this section is to illustrate the application of 
out results in the design of a linear optima! receiver, and to 
compare its performance with other receivers for a digital 
satellite link. 

In our model of the linear part of the satellite link, we 
assume that the LSI is introduced by a 3-pole Burterworth filter. 
The rwo sided bandwidth B of the filter is the same as the 
minimum Nyquist rate (i.e.. BT— 3). The number of samples 
considered for the 1S1 is determined by those 1SI samples whose 
magnitude are at least greater than 0.01 times the main sample. 
In our example, a channel memory (N1-T-N2) of 3 ISI terms was 
considered adequate. 

The characteristics of the TWT for this study are the same as 
those in Figure 2. Thus in the evaluation of P(r(n)] in (15), the 
parameters of the TWT are a= 2 .0922 and fl= 1.2466. As 


mentioned before, those values were taken from S aleh Q8J , 
Figure 5) and r ep re sen t a specific satellite TWT. The gain factor 
A, erf (14) was determined so that with do 153 the TWT would 
operate at the 2 dB input backoff point. Because erf the kw ISI 
introduced by the transnisaoo filter, a 4-tap (M1+M2+1-4) 
TDL linear receiver was considered to be adequate. Thus, 
i-2<*~«)«64. 

Now we co mpare our optimum linearly equalized MSE 
receiver with the conventional linear receivers. Using the brute 
force technique described in Section 4, the bit error probability 
far the various recovers was evaluated and plotted in Figures 4 
and 5, for values of SNR as defined in (28). 

Figure 4 exhibits the P. performance at the designed MSE 
filter, and the P, performance of two 3- pole Butterworth 
receiving filters. One receiving filter (with BT- 1) is identical to 
the transmitting filter, while the other one has BT- 0.75. In 
Figure 5, the performance of the M.S receiver is compared with 
that of two 4- pole Butterworth receiving filters. One has 
BT-0.75 and the other one has BT-1. A numerical search 
proc e dure for Butterworth filters with different BT products, 
ihowed that an increase in BT does not n ece s sari ly correspond to 
an improved P, pe rfo rmance. In fact, filters with BT-2 are 
only marginall y better than filters with BT— 1, 



ncclrUg fllun. 


For P, = 10E-6, the optimum MSE receiver is at least 0.5 
dB better than the 3-pole Butterworth filters and 1.2 dB bene? 
than the 4-pole Butter-worth filters. The P, performance of a 
channel with oo ISI. but with the identical TWT, carrier power 
and noise variance was evaluated. The numertcal results showed 
tha t for these examples the bit error rate of the MSE equalizer is 
very close to that of the no IS! case (10) . 
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VI. SUMMARY AND CONCLUSIONS 

Is this paper we considered the problem of modeling and 
equalization of a digital satellite nonlinear and 
channel. Starting from a typical satellite link, we developed the 
corresponding BPSX discrete-time model, and solved for the 
optimum linear MSE receiver. A ample and computationally 
efficient algorithm was derived for the evaluation of the 
equalizer coefficients, based oo the memory! ess nonlinearity of 
the system. Numerical examples for a typical satellite link 
demonstrated that the optimum linear MSE receiver outperforms 
die conventional linear type receiving filters. In general, our 
modeling and equalization techniques provide a ample and 
computationally efficient alternative to existing approaches. 
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